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Abstract 

An interleaver is a critical component for the channel coding performance of turbo codes. Algebraic con- 
structions are important because they admit analytical designs and simple, practical hardware implementation. The 
spread factor of an interleaver is a common measure for turbo coding applications. Maximum-spread interleavers 
are interleavers whose spread factors achieve the upper bound. An infinite sequence of quadratic permutation poly- 
nomials over integer rings that generate maximum-spread interleavers is presented. New properties of permutation 
polynomial interleavers are investigated from an algebraic-geometric perspective resulting in a new non-linearity 
metric for interleavers. A new interleaver metric that is a function of both the non-linearity metric and the spread 
factor is proposed. It is numerically demonstrated that the spread factor has a diminishing importance with the 
block length. A table of good interleavers for a variety of interleaver lengths according to the new metric is listed. 
Extensive computer simulation results with impressive frame error rates confirm the efficacy of the new metric. 
Further, when tail-biting constituent codes are used, the resulting turbo codes are quasi-cyclic. 

Index Terms 

algebraic, geometry, interleaver, permutation polynomial, quadratic, quasi-cyclic, spread, turbo code. 
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I. Introduction 

Interleavers for turbo codes [1]— [14] have been extensively investigated. However, the design of inter- 
leavers for turbo codes is complex enough and we believe there are still several relevant open questions. 
Recently, Sun and Takeshita [1] suggested the algebraic approach of using permutation polynomial-based 
interleavers over integer rings. In this paper, we expand the theory in [1] by adding a geometric and 
group-theoretic perspective. Several new results and important and interesting new questions arise with 
this framework. 

We believe that the approach in [1] has major advantages over any earlier interleaver constructions 
(either pseudo-random or structured) because it simultaneously provides: 

• Excellent error performance with practical code-lengths [15]. 

• Completely algebraic structure with elegant and relevant properties [15], [16]. 

• Efficient implementation [17] with high-speed, low-power consumption, and little memory require- 
ments. 

A. Interleavers and Permutation Polynomials 

An interleaver is a device that permutes a sequence of N symbols. Let each symbol be indexed by an 
element in the set S N — {0, 1, . . . , N — 1}. Then the interleaver can be represented by a one-to-one onto 
(permutation) function / : S N — > S N given by / : x t— > f(x). 

Permutation polynomials over Zjv are functions that belong to the ring TZ^ = Zjy[x], polynomials 
of the form q(x) = J2f=o Qi xl ( m od N) such that q t e Z N and q : Z N — > Z N is a permutation function. 
In earlier work, we only treated constant-free PPs, i.e., q = 0; in this paper, we also consider q ^ 0. 
The set of permutation functions (not necessarily permutation polynomials) for a given interleaver length 
N will be denoted by Vn- The set Vn is no longer a ring but its elements form a group under function 
composition. 

Permutation polynomials over Z N naturally generate interleavers where S N gets equipped with a finite 
ring structure Z N , which is not necessary for the definition of an arbitrary interleaver but allows a useful 
algebraic treatment of PP interleavers. Replacing Sn by Zjv in the case of arbitrary interleavers brings 
no loss of generality, therefore from here on we will always use Zjy. The algebraic structure of PPs 
over finite integer rings has already been proven very successful in producing turbo codes [15] and low 
density parity check (LDPC) codes [18] with excellent error performance compared with the best known 
constructions and similar parameters. 

Conditions for the coefficients of a polynomial over Z^r to be a PP for an arbitrary integer iV were 
studied in [1]. However, the conditions are not the simplest for polynomials of degrees larger than two; to 
the best of our knowledge, simple necessary and sufficient conditions for arbitrary degrees are only known 
when N is a power of two [19]. If q(x) is of second degree and N is arbitrary then a simple necessary 
and sufficient condition was proved in [1] and summarized in [15], [16]. Interleavers constructed using 
second degree or quadratic permutation polynomials will be called QPP interleavers, linear interleavers if 
the PP is of first degree, and PP interleavers for PPs of arbitrary degrees. 

B. Good Interleaver Measures 

Because the number of distinct permutations of length N is N\, it is very important that effective 
interleaver measures for turbo codes are defined; this considerably reduces the number of interleavers that 
still need to be filtered by costly analysis and computer simulations for a complex turbo codec system. The 
main drawback of the theory in [1] was that despite it provided some rules for choosing good permutation 
polynomials (PP), the procedures were too complex when handling input weights larger than two. In 
this paper, we propose a new simple but effective measure f2 for interleavers. Two typical measures for 
interleavers in turbo coding are the spread factor D [8], [12] and "randomness." In this paper, the notion of 
"randomness" is replaced by a more principled concept of a degree of non-linearity ( of an interleaver. An 
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interleaver is represented by what we call an interleaver-code, which is the geometric representation of an 
interleaver by pairs of coordinates (x, f(x)) forming points in 1? N . The degree of non-linearity C, measures 
the number of disjoint orbits (a set of points) of the action of an isometry group of the interleaver-code. 
The new measure is simply the product of the logarithm of the spread factor by the new non-linearity 
metric, i.e., Vt = ln(_D)£. The algebraic-geometric nature of PPs allows a very efficient selection of PPs 
that maximizes the new metric. 

DRP interleavers [9] are among the best known interleavers for turbo codes with a combined excellent 
error rate performance (exceeding that of S— random interleavers [12]) and simplicity but are not fully 
algebraic. The efficacy of the new metric is shown by simulation curves of several turbo codes using 
PP interleavers with impressive frame error rate performance, similar to the ones with DRP interleavers. 
However, the selection of good PP interleavers (particularly QPP interleavers) is much simpler with the 
results presented this paper. 

C. The Relationship between D and ( 

The non-linearity metric ( is shown to be inversely related to the degree of shift-invariance e = l/( of 
an interleaver. For QPP interleavers, the shift-invariance e is computed in closed form as function of the 
second degree coefficient, which gives us a complete control of this parameter. When tail-biting codes are 
used as constituent codes, turbo codes using QPP interleavers become quasi-cyclic; for those codes, it is 
predicted that the multiplicity of many low-weight codewords is typically multiples of the shift-invariance 
e. It is also shown that a lower bound on the spread factor D constrained to points within an orbit of 
an interleaver-code has a closed form for QPP interleavers. An immediate tie between D and ( is then 
established for QPP interleavers where one would need to trade for either larger Z) or (. 

This paper is organized as follows. In Section [ill maximum- spread interleavers are investigated and 
a list of good permutation polynomials for turbo codes for several lengths that maximizes the spread 
factor D is found in Table 0] A new metric for interleavers is developed in Section [Oil we provide a 
table (Table ITTTI) of good permutation polynomials for turbo codes according to the new metric. Numerical 
results are shown in Section QV] via the computation of the distance spectra and computer simulations for 
several codes. Finally, conclusions and possible future directions are discussed in Section fVl 

II. Maximum-Spread Interleavers 

In this section, the spread factor of an interleaver is revisited. An infinite sequence of QPP interleavers 
achieving the upper bound on the spread factor is presented. Further, a list of QPP interleavers with 
optimal spread factors for several interleaver lengths reported in the literature is provided. 

A. A Geometric View of Interleavers 

In the algebraic-geometric treatment in this paper, it will be convenient to view an interleaver represented 
by a permutation function f(x) (not necessarily a permutation polynomial) as an interleaver-code F (not 
to be confused with a turbo code) under the natural mapping $ : Vn — ► gi ven by $ : f(x) i— > F, 
where F = {(x, f(x))\x £ Zjv}- We will call a pair (x, f(x)) as a point p x = (x, f(x)) £ F. Let a linear 
interleaver be given by the PP l{x) = 31x (mod 512); the corresponding interleaver-code L = $(/) is 
plotted in Fig. [lj 

The notion of distance or metric between points in an interleaver-code F will be of central role. We 
will mainly use two different metrics. 

1) Li metric: Let us define a distance 5 in Z 2 N to form a metric space (Z 2 N ,5), 

S(Pxi,Px 2 ) = \xi -x 2 \ + |/(xi) - f(x 2 )\, 
i.e., the metric is the L\ or Manhattan metric. 
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Fig. 1. The interleaver l(x) = 31a; (mod 512) viewed as an interleaver-code L — over 1? N . 

2) Lee metric: Let us define a distance 5n in I? N to form a metric space (7i%,6n), 

^n(p Xi ,Px 2 ) = \xi - x 2 \n + \f(xi) - f(x 2 )\N, 

where 

\i ~ 3\n — min{(? i — j) (mod N) , (J — i) (mod iV)} 
is the Lee distance [20] between i and j modulo N. Therefore, 5n is a two-dimensional Lee metric. 

B. The Spread Factor of an Interleaver 

The spread factor [12] of an interleaver is a popular measure of merit in turbo coding applications. The 
spread factor of an interleaver f(x) over the metric space (Z 2 N: 5) is defined as 

D E (f) = min {5(p hPj )\p hPj E F}. (1) 

The root of this measure is the early recognition in turbo coding that self-terminating information sequences 
of weight two create low-weight codewords [12]. Divsalar and Dolinar then proposed a construction of 
linear interleavers achieving spread factors D E equal to or close to y/2N. They have concluded that by 
using linear interleavers, the minimum distance of turbo codes conditioned to weight-two self-terminating 
information sequences grows roughly as y/2N. However, recent results show that the true minimum 
distance grows asymptotically only at most logarithmically [21] for all interleavers. If we use the metric 
space (Z 2 n ,5n) then the following definition of spread factor is also possible [8]: 

D(f)= min {6 N (Pi,Pj)\Pi,Pj e F}. 

The spread factor D is mathematically more convenient because the metric space (Z^, 5n) is "isotropic" 
(in the sense of having no boundaries). It is also more suitable when designing turbo codes with tail- 
biting convolutional constituent codes [8]. An analytical proof on the upper bound ubn(N) of D was 
recently shown to be V2N [22]. Clearly D < D E by the definition of 5. We show ub DE (N) is close to 
ubo(N) by computing a new upper bound ubD E (N). It is a constructive bound for certain values of N. 
See Appendix 0] for a sketch of a proof. 

, N = 2p\ p = 2,3,4... 
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Fig. 2. The difference ubD E (N) — ubn(N). 



The difference ub EE (N) — ub E (N) goes to 1 as iV grows (See Fig. O. 

Only one example was found (for a limited search) of an interleaver (up to symmetries) that has a spread 
factor D E exceeding w&£>(4). For N = 4, the interleaver t : Z 4 — > Z 4 defined by t(0) = 1, t(l) = 3, 
t(2) = 0, and t(3) = 2 has 

m6d(4) = 2.8284 < D E (t) = 3. 

Our new bound © is not defined at iV = 4 but for this case clearly an upper bound is «&d s (4) = 3 
by inspection, i.e., an upper bound on D E strictly larger than w&d(4) is achievable. The main message 
learned is that in practice considering D is good enough. For the remaining of the paper, we will only 
use D instead of D E , unless otherwise noted, because D lets us use the algebra of 7L N . 

Definition 1: An interleaver of length iV is a maximum- spread interleaver if it achieves a spread factor 
D equal to the upper bound 1 \/2N . 

Once more, Dolinar and Divsalar [12] have reported that linear interleavers either achieve or closely 
approximate a spread factor of V2N for any N. In particular, if iV is twice of a perfect square 

N = 2n 2 , n = 1,2,3,..., (3) 

they have given all maximum- spread linear interleavers of the form f(x) = f\% (mod N = 2n 2 ) by an 
explicit simple condition for fi . However, they pointed out that the resulting interleavers were not good for 
turbo coding because of their high regularity (see Fig.[U which corresponds to a plot of a maximum- spread 
linear interleaver). This fact is also theoretically addressed by the linear interleaver asymptote in [7], which 
implied the existence of low-weight codewords of input-weight four and a high multiplicity, close to N. 
Therefore they proposed a semi-random interleaver construction algorithm [12], generating the so-called 
S-random interleavers with a parameter S, but the algorithm sacrificed the spread factor D. The obtained 
spread factor is typically D = S + 1 < a/ N/2 + 1, i.e., smaller than about 50% of the upper bound 
ubo{N) = y/2N. An ^-random interleaver yield turbo codes with very good error rate performances and 
became the typical benchmark interleaver. One of the main drawbacks of 5-random interleavers is a costly 
storage of a sequence of N integers needed to specify the interleaver. Because the construction algorithm 

'Because the spread factor must be an integer, the upper bound is straightforwardly tightened to |_V2iVJ . However, this will be of little 
relevance in this paper and we keep V27V for simplicity, unless otherwise noted. 
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relies heavily on a pseudo-random number generator, the sequence has little margin for compression. 
This characteristic also makes more difficult for an accurate reproduction of the results by others because 
typically only the parameter S is reported in the literature; however, the repeatability problem is not so 
critical because in general, for a given parameter S, instances of S-random interleavers perform similarly 
for error rates that are not extremely low, which also reflects a good minimum distance of the associated 
turbo code. Crozier proposed two interleaver constructions [8] that attempt maximization of the spread 
factor D but avoid or minimize the regularity of linear interleavers: the high-spread construction and the 
dithered-diagonal construction. The dithered-diagonal interleavers [8] are reported to be maximum- spread 
for interleaver sizes as in © and have large spread factors for others. Dithered-diagonal interleavers 
require n = y/N/2 integer parameters for their definition. An impressive error performance, exceeding 
the performance of £ -random interleavers was shown for N = 512 [8]. This was a great progress in the 
field of interleaver constructions for turbo codes because it produced a large spread factor D combined 
with sufficient irregularity to produce an excellent error performance and a much smaller number of 
integer parameters specifying the interleaver compared with S-random interleavers. Subsequently, Crozier 
and Guinard proposed dithered relatively prime (DRP) interleavers [9]. DRP interleavers also perform 
very well but require a much smaller number of integer parameters for their specification. Their typical 
choice for a good performance requires about 10 integers 2 for their dither parameters M = R = 4. For 
an excellent performance, their dither parameters M = R = 8 require about 18 integers. 

C. The Spread Factor of QPP Interleavers 

Interleavers based on QPP require only 2 integers as parameters with the simplicity of only a simple 
quadratic congruence as the algorithm to generate the permutation sequence. In fact, QPP interleavers 
can be implemented in hardware with only additions and comparisons [17]. If we fix N, what is the 
largest spread for a QPP interleaver? An exhaustive search for the largest achievable spread D max (N) for 
2 < N < 4096 is shown in Fig. |3] Due to several algebraic and geometric properties of QPP interleavers 
explained in Section |TTTl the exhaustive search is efficiently completed in a very short time on a regular 
personal computer using Theorem |7] 

A few of the polynomials for some commonly found interleaver lengths in the literature are reported in 
Table HI Some of the QPPs in Table 0] generate very good turbo codes, however, better QPPs that do not 
simply attempt maximization of the spread factor are provided in Section IIII-E1 

Observing once more Fig. |3J at least in the searched range, the fraction of maximum- spread QPP 
interleavers is very small. The same plot, however, reveals that the majority of QPP interleavers with 
the largest spreads lie between ubo(N) = \/2N and y/N (about 70% of the upper bound). Recall that 
S -random interleavers typically achieve only 50% of ubn^N). It is also important that spread factors 
D max (N) are shown only when there exist QPP interleavers for a given N in a strict sense, i.e., with 
irreducible degree, as explained in Section III-EI Linear interleavers always exist for any iV but this is not 
true for QPP interleavers [1], [16]. Between 2 < N < 4096, there are 1190 values of N that produce a 
QPP interleaver (roughly 29%). This raises another question as to what values of iV have QPP interleavers 
in the strict sense. 

Theorem 1: Let iV = 2 3 m = 8m for some m E {1, 2, 3, . . .}. Then there exists a quadratic permutation 
polynomial f(x) = fix + f 2 x 2 (mod N) with irreducible degree. 

Proof: One simply chooses / 2 = 2m and f\ — 1, which satisfy the necessary and sufficient 
conditions for a quadratic permutation polynomial in [1]. The chosen polynomial is not reducible to 
a linear polynomial because, by Theorem |3J its degree of non-linearity is ( = 2. ■ 
Theorem [l] may be of practical relevance because it guarantees the existence of QPP interleavers for all 
positive multiples of a typical computer byte size of 8. 



2 The length of the input parameters are more precisely defined in Section llV-B.ll 
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D. The Maximization of the Spread Factor D 

The maximization of the spread factor D is clearly beneficial in the minimization of the number of low- 
weight codewords caused by self-terminating weight-2 input sequences. This concept trivially generalizes 
to short bursts of self-terminating input sequences, which then include the classical weight-2 input. Should 
we then look for interleavers that always maximize the spread factor? To understand the context of this 
question, we make the following observations: 

• Many linear interleavers are maximum- spread but suffer from high-multiplicity low-weight code- 
words [7]. 

• At least one dithered diagonal interleaver [8] is maximum- spread and provides an impressive error 
performance. 

• DRP interleavers which maximize error performance are typically not maximum- spread [9]. 
Although it is not possible to generalize from the single example reported in [8], from observation 2), the 

best interleavers from an error rate perspective may be the ones that either achieve or closely approximate 
a maximum- spread interleaver and simultaneously have a large degree of "randomness." Interleavers with 
some structure such as DRP and our PP interleavers (or low-entropy, as discussed in Section lrV-B.il ) may 
need to give up some spread factor in order to convert some of its entropy for "randomness." 

A common practice for a more accurate estimation of error performance away from asymptotics is not 
only to examine the minimum distance of a code but also the distance profile. Similarly, as we better 
understand PP interleavers, the spread profile may become more important. We define the multiplicities 
of the spread profile of an interleaver-code F as 

A Di,p x = \{p Xl \i = $n(Px,P Xi ),Px ±Vxx,Vx,Vx x e F}\, 

where D i: i = 1,2,..., [v^iVj , is the z-th spread. Good interleaver-codes are in general non-linear 
(see Section ITTTb. and therefore the spread profile above is a function of each point p x E F. For arbitrary 
interleavers, computing the spread profile becomes difficult without a brute force search because the 
interleaver-code induced by $ is highly non-linear. However, for PP interleavers, the spread profile can be 
inspected just for the representatives of the orbits. In fact, what we proposed in [1] can be interpreted as 
the creation of "spectral nulls" in the spread profile for self-terminating weight- 2m sequences and giving 
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TABLE I 

QPPS WITH THE LARGEST SPREAD FACTORS _D max (iV). 



N 


/O) 




D max (iV) 


c 


c 


40 


x + 10a; 2 


2lx + 10x* 


4 


2 


2 


80 


9x + 20a; 2 


49a; + 20a; 2 


10 


2 


2 


128 


15x + 32a; 2 


111a; + 32 2 


16 


2 


2 


160 


19a: + 40a; 2 


59a; + 40a; 2 


16 


2 


2 


256 


15a; + 32a; 2 


239a; + 32a; 2 


16 


4 


3 


320 


19a; + 40a; 2 


59a; + 40a; 2 


20 


4 


3 


400 


17x + 100x 2 


153a; + 100a; 2 


20 


2 


2 


408 


25a; + 102a; 2 


253a; + 102a; 2 


24 


2 


2 


512 


31x + 64a; 2 


479a; + 64a; 2 


32 


4 


3 


640 


39a; + 80a; 2 


279a- + 80a; 2 


32 


4 


3 


752 


31x + 188a; 2 


655a; + 188a; 2 


32 


2 


2 


800 


17a; + 80a; 2 


753a; + 240a; 2 


32 


5 


5 


1024 


123a; + 256a; 2 


691a; + 256a; 2 


34 


2 


2 


1280 


39a; + 80a; 2 


279a; + 80x 2 


40 


8 


4 


1504 


183a; + 376a; 2 


263a; + 376a; 2 


46 


2 


2 


1600 


49a; + 100a; 2 


849a; + 700a; 2 


50 


8 


4 


2048 


63a; + 128a; 2 


1983a; + 128a; 2 


64 


8 


4 


2560 


79a; + 160a; 2 


1199a; + 160a; 2 


64 


8 


4 


3200 


79x + 800a; 2 


3119a; + 800a; 2 


80 


2 


2 


4096 


173x + 1024a; 2 


2853a; + 1024a; 2 


80 


2 


2 



up the maximization of the first spread spectral line D\. The shaping of the spread profile may be a 
promising way for designing and searching for good PPs. 

E. An Infinite Sequence of Maximum-Spread QPP Interleavers 

Theorem 2: The following is an infinite sequence of QPPs that generate maximum-spread interleavers. 

f(x) = {2 k - l)x + 2 k+1 x 2 (mod2 2fe - 1 ) fc = 1,2,3,... (4) 

Proof: See Appendix UTTl ■ 
Strictly, we have QPP interleavers only when k > 3. The first observation is that for k = 1 and k = 2, 
the corresponding QPPs f(x) are immediately reduced to first degree polynomials because the second 
degree coefficient / 2 = (mod N). We now show after some preliminaries that for k = 3, the QPP f(x) 
is also reducible to a first degree polynomial although f 2 = 2 k+l = 16 ^ (mod iV = 32). 

Definition 2: A polynomial z(x) (mod N) that evaluates to zero for all ) = (mod N) Vx 

is called a zero-polynomial. 

Proposition 1: Let N be an integer factorable as N = pq. The following is a zero-polynomial of degree 

p. 

p-i 

z(x) = mq Y\( x + ^ + i) (mod N) VA;, m G Zjy, 

Proof: Exactly one of the numbers in the sequence x + k + i, < i < p is congruent to modulo 
p. Therefore z(x) must evaluate to zero for all x because mqp = (mod N). ■ 
Proposition 2: Let a polynomial p(x) mod N and a zero-polynomial z(x) mod N. Then s(x) = 

+ 2;(x) (mod iV), i.e., s(x) and p(x) + z(a;) are equivalent functions modulo N. 

Proof: This follows directly from the definition of a zero-polynomial. ■ 
From Proposition [TJ the following is a zero-polynomial of second degree for iV = 32 



z(x) = 16x(x + 1) = 16a; 2 + 16x (mod 32). 
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Therefore for k = 3, by adding f(x) to z(x) we obtain the equivalent first degree polynomial 

s(x) = f(x) + z(x) = (16x 2 + 7x) + (16x 2 + 16x) = 23x (mod 32). 

For k > 3, the polynomials are not reducible to first degree polynomials because they have a degree 
of non-linearity ( larger than 1 as explained in Section |ni| (In fact, for fe = 1,2,3 we have £ = 1). The 
first six terms of maximum- spread QPPs that are not reducible to first degree polynomials are shown in 
Table UH The last three columns of the table are the degrees of non-linearity (, the refined degree of 
non-linearity (' and the degree of shift-invariance e as explained in Section |ni| 

TABLE II 

Examples of Maximum-Spread QPP interleavers 



k 


N 




r x (z) 


D = ubn(N) 


c 


C 


e 


4 


128 


15a; + 32a; 2 


-17a; + 32a^ 


16 


2 


2 


64 


5 


512 


31a; + 64a; 2 


-33a; + 64a; 2 


32 


4 


3 


128 


6 


2048 


63a; + 128a; 2 


-65a; + 128a; 2 


64 


8 


4 


256 


7 


8192 


127a; + 256a; 2 


-129a; + 256x 2 


128 


16 


7 


512 


8 


32768 


255a; + 512a; 2 


-257a; + 512a; 2 


256 


32 


12 


1024 


9 


131072 


511a; + 1024a; 2 


-513a; + 1024a; 2 


512 


64 


23 


2048 



The inverse functions / 1 (x) are also provided in Table HTl The closed form expression for / l (x) is 

f-\ x ) = (_2 fc - l)x + 2 k+1 x 2 (mod 2 2fc " 1 ). 

One easily verifies that /(/^ 1 (x)) = f~ 1 (f(x)) = x (mod 7Y). For general QPPs, we are not aware of 
a closed form expression for the inverse functions. Further, not all QPPs have an inverse polynomial that is 
a QPP. This was first observed in [23]. However, if it exists, it is efficiently computed algebraically using 
the extended Euclidean algorithm [16]. It is easily verified that the necessary and sufficient condition for 
the existence of a QPP inverse [16] for the polynomials in Theorem |2] is satisfied. 

III. An Algebraic-Geometric View of Interleavers 

In this section, PP interleavers are tied to an algebraic-geometric view by examining the isometries of 
the associated interleaver-codes. A new measure for interleavers arises as a consequence. The measure is 
easily computed for QPP interleavers using their algebraic-geometric properties. A list of QPP interleavers 
which maximize the new measure is provided. Finally, some comments on larger degree PPs are made. 

A. A New Measure for Interleavers 

The following framework is well known in the context of geometrically uniform codes [24] . A treatment 
of groups and geometry is found in [25]. A symmetry of a metric space T = (Zjy-, 5jv) is a mapping 
of T to itself such that the distance between points are preserved. We are only interested in the set of 
symmetries obtained by translations of the space Z 2 N (i.e., circular "slides" in the vertical, horizontal 
directions and their combinations) because the symmetries obtained by translations are exactly the ones 
tied to the multiplicity of codewords in a turbo code (other possible, but not allowed, symmetries in this 
paper are rotations and reflections). The algebraic equivalent of a translation A(k , ki) : Z 2 N — > Z 2 N that 
circularly "slides" to the right by k and upwards by k\ is given by 

A{k , fci) : (x , xi) i {x + k , xi + fci), k , k x E Z N . 

The set of symmetry functions forms a group Q under function composition. Further, since the only 
symmetries allowed are translations, Q is clearly a commutative group isomorphic to C% (the Cartesian 
product of two cyclic groups of order N). An isometry of an interleaver-code F is a symmetry A of T 
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inducing A : F i— > G such that F = G. The set of isometries of F form a subgroup of Q. We say that 
a point pa-j G F is equivalent to a point p X2 G F when there exists an isometry A of F that maps p xi to 

Definition 3: Let F be an interleaver-code. The orbit of a point p x 6 F is the set of points C Pa , 
equivalent under the action of the isometry group 7Y. 

Proposition 3: (Theorem 5.1 [25]) There is just one way to express F as the disjoint union of a family 
of orbits. 

Definition 4: The degree of non-linearity C(^) °f an interleaver F is the of number of distinct orbits. 

Proposition 4: All orbits have the same size. 

Proof: This is straightforward from the fact that the only allowed symmetry functions are translations 
and Proposition |3] ■ 

Definition 5: The degree of shift-invariance e(F) of an interleaver F is the size of the orbits. 

Proposition 5: The degree of non-linearity £ and the degree of shift-invariance e of an interleaver of 
length N are related by ( = N/e. 

Proof: This follows directly from their definitions and Proposition HJ ■ 

Clearly 1 < £, e < N. Let l(x) = l\X (mod N) a linear permutation polynomial inducing an interleaver- 
code L via $. A possible symmetry of L is l(x) = l(x — 1) — 1\. Then the degree of non-linearity of L is 
C(L) = L the smallest possible. It is reasonable that a randomly chosen permutation function r(x) 
induces an interleaver-code R via $ : r(x) i— ► R whose degree of non-linearity is likely to be C(i2) = N, 
i.e., the largest possible, especially if iV is large. 



B. The degree of non-linearity of QPP interleavers 

Let us compute the degree of non-linearity of QPP interleavers q(x) = q\X + q 2 x 2 (mod N) by finding 
the isometry mappings for the interleaver-code Q. 

Theorem 3: The degree of non-linearity of a QPP interleaver Q given by q(x) = q\X + q 2 x 2 is ((Q) = 
N/gcd(2q 2 ,N). 

Proof: See Appendix IIV1 ■ 
From the proof of the Theorem and because p = (0, 0) e Q if we assume a constant-free QPP, the 
set 



O po = {(k (i),h(i))\i = 0, 1, • • • , gcd(2g 2 , N) - 1} 

is precisely one of the orbits in Q. 

Theorem 4: The orbits for the sequence of maximum- spread interleavers in © are interpolated by a 
linear curve. 

Proof: This follows from the proof of Theorem |2l where the orbits are exactly intersections between 
linear curves and the QPP. ■ 

Theorem 5: Let p Xl ,p X2 G 0(0,0) and p Xl ^ p X2 . A lower bound on the distance 5 N (p Xl ,p X2 ) is 
2iVgcd(2g 2 ,iV). 

Proof: Half of the distance 2iVgcd(2g 2 , N) is from the minimum distance in set {k (i)}. The other 
half is from the minimum distance in the set {ki(i)}, which turns out to be also equally separated by 
by the MCF Theorem in [15]. " ■ 

To find the other orbits, we only need one representative from each. 
Theorem 6: A complete set of representatives for the distinct orbits of Q is 

{(i,/(i))|i = 0,l,...,JV/gcd(2g 2 ,JV)-l}. 



Proof: This is so because the orbits are disjoint and to have a point belong to the same orbit, 
they must be no closer than N/ gcd(2g 2 ,iV) in either coordinate by Theorem |5j These must cover all 
representatives because the number of distinct orbits is Nj gcd(2g 2 , N). ■ 
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The decomposition of the interleaver defined by f(x) = 31x + 64x 2 (mod 512) into its four disjoint 
orbits is shown in Fig. HI 




Fig. 4. The interleaver f(x) = 31a; + 64a; 2 (mod 512) decomposed into its four disjoint orbits. 

It is interesting that the placements of the points in both plots in Fig. HI are exactly the same; however, 
the regularity (linearity) of the interleaver gets clearly stressed on the right plot. 

Definition 6: Let Q be a interleaver-code generated by an arbitrary PP. The local spread of a point 

p x e Q is 

D Px = mm{5 N (p x ,Py)\6 N (p x ,p y ) < V2N, V2N}. 
We have now the following Theorem on an efficient computation procedure for the spread factor D of 
PP interleavers. 

Theorem 7: Let Q be a interleaver-code generated by an arbitrary PP and let {p x } be a set of repre- 
sentatives for each orbit in Q. The spread factor Q can be computed by 

D = min{D Py \p y E {p x }}- 

Proof: This follows from the fact that all points in a particular orbit are equivalent under translations 
and a local spread cannot exceed the upper bound on D. ■ 

C. A Refined Non-linearity Metric 

One problem with the non-linearity metric ( is that it does not capture the notion of orbits that are 
disjoint but are "co-linear," i.e., there exists a linear curve interpolating them. We propose another non- 
linearity metric (' < ( that fixes part of this problem. A QPP q(x) = q\X + q 2 x 2 (mod N) can be 
decomposed in two monomials, one corresponding to the first degree term qix (mod N) and the other 
to the second degree term q 2 x 2 (mod N). In most cases, we have gcd(gi,iV) = 1 for a valid QPP, 
which means that q x x (mod N) is a linear permutation polynomial (in the case that gcd(gi,iV) / 1 a 
generalization is possible). A QPP can therefore be viewed as a linear PP that is "disturbed" 3 by q 2 x 2 
(mod N) at every position x. For example, the point at coordinate x = gets disturbed by q 2 2 = 0, the 
point at coordinate x = 1 gets disturbed by q 2 l 2 = q 2 and so on. By Theorem the periodicity of the 
disturbance is at most (. The non-linearity £' simply measures how many distinct elements we have in the 
set {q 2 x 2 (mod N)\x = 0, 1, . . . , ( — 1}, which is a very simple measure. The values for (' in Table HH 
reveal that they do not grow as fast as (. 

3 There is a similarity with DRP interleavers where a linear permutation polynomial is "dithered." However, as argued in Section HV-B. II 
DRP and PP interleavers are not the same. 
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D. Low-Weight Codewords in Turbo Codes with Uniterleaved Dual Termination 

Parallel concatenated turbo codes using trellis termination such as the one in the 3GPP standard (both 
trellises are terminated but termination bits in neither constituent codes are interleaved) are known to 
suffer from low-weight codewords if a weight-one input sequence near the end of one constituent code 
maps to a near-end position in the other constituent code. This fact is confirmed for 3GPP codes in [26]. 
Similar effects for larger input weights also happen and will be called in general as edge effects. The 
termination method will be called uninterleaved dual termination (UDT). To minimize edge effects, the 
following is desirable to be maximized: 

C = min 6((N -1,N- 1), (x, f(x))) 

We will call C the corner merit of an interleaver because geometrically it means avoiding points in the 
right upper corner of F. A lower bound on the corner merit C is guaranteed for permutation polynomial 
interleavers with a constant term in the polynomial equal to zero. 

Proposition 6: Let the constant coefficient of the permutation polynomial f(x) be zero, then in the 
interleaver-code F = $(/), (0, 0) e F. This implies C > D - 2. 

Proof: This follows directly from the definition of the spread factor D and the placement of one of 
the points in F at (0, 0). ■ 
Therefore, a corner merit is automatically guaranteed if the spread factor D is reasonable. The concept 
is also valid for any interleaver with a spread factor D and one of its points placed at (0,0). For PP 
interleavers, the corner merit is often improved over the lower bound in Proposition |6] by selecting a 
proper constant term for the PP, i.e., searching over possible vertical translations of the interleaver-code 
(it may be further improved by examining all translations of the interleaver-code). It is also possible that 
optimizing edge effects for input-weight one sequences may degrade edge effects for other low-weight 
input sequences. 

Low-weight codewords induced by UDT must have relatively low multiplicities because they are caused 
by edge effects. If the interleaver is properly designed, they have little impact at moderate frame error 
rates. However, if extremely low frame error rates are desired, a removal of edge effects looks necessary. 
To remove this edge effect, there are two approaches: tail-biting convolutional codes [27] and interleaved 
dual termination (IDT) [28]. 

The tail-biting approach implies an additional complexity for encoding and decoding. In [18] a con- 
struction for LDPC codes using QPPs was proposed; it is also proved that they are quasi-cyclic. A similar 
argument that is made in [18] can be made to prove that turbo codes using PPs are quasi-cyclic when 
tail-biting convolutional codes are used. We also state here without giving details that for tail-biting 
PP turbo codes, the multiplicities of the low-weight codewords are typically multiples of the degree of 
shift-invariance e. 

A second form of avoiding edge-effects is by using IDT as proposed in [28]. Effectively, what this 
termination method produces is a sub-code of a tail-biting turbo code by choosing a particular time in the 
circular code and expurgating codewords that start/end at states other than zero. This costs a reduction in 
rate, and the re-introduction of edge effects. However, because this is a sub-code of the tail-biting form, 
the weight spectrum must be better than the "mother" tail-biting code. Further, encoding is also a little 
more complex than regular turbo encoders but decoding has the same complexity. 

E. A Simple Metric for Permutation Polynomial Interleavers 

We introduced in [1] a procedure for the selection of QPPs matched to a choice of a constituent 
convolutional code that had in mind the elimination of self-terminating input sequences of weight 2m for 
small integer m's. The procedure is, however, too cumbersome for m > 1. We propose now a simpler 
concept that has its objective the maximization of the following metric for an interleaver f(x): 



n(/) = in(i>(/))c(/). 



(5) 
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In other words, we want to maximize the product of the logarithm of the spread factor by the degree 
of non-linearity of the permutation interleaver. The reasoning is that the minimum distance of a turbo 
code is now known to grow at most logarithmically; therefore the spread factor that controls the effective 
free distance should be "rewarded" at most logarithmically. The non-linearity £ is expected to have a 
proportional reduction in the multiplicities of low-weight codewords so it is reasonable to leave it as is. 
The corner merit C is indirectly considered because f2 is a factor of D and a lower bound for C is D — 2 
(See Proposition 0). With this new approach, we step aside from attempting to optimize the interleaver 
for a particular convolutional code as was done in [1]. This simpler measure becomes more important 
as we investigate more complex polynomials of larger degrees and larger lengths. However, this measure 
is still very empirical and further understanding is desirable. As we have defined a refined non-linearity 
metric we have a corresponding refined metric 

n'(f) = \n(D(f))C(f). (6) 

Interleaves for turbo codes were originally constructed with random properties with the argument that 
multiplicities of "bad input weights" are reduced. We believe this is an introduction of steps to remove the 
notion of a less precise notion of "randomness" in turbo codes to more principled concepts. We generated 
the new Table ITITl of possibly good interleavers using this new metric and the idea of not to being greedy 
in the maximization of the spread factor (see Section Hl-DI) . The table lists polynomials for which ft' is 
maximized and with a spread factor D larger or equal to Pubn(N); the associated interleavers will be 
called Q' QPP interleavers. The threshold (3 makes sure that the spread factor does not get too small for 
small block lengths. A reasonable threshold has been determined experimentally. In fact, as the block 
size increases, (3 is let become smaller; this means a maximization of the spread factor is considered less 
important for larger block lengths. When multiple polynomials with the same product merit Q! exist, we 
list the one with smallest coefficient for f 2 and then for fa. Inverse polynomials that are also QPP are 
listed when they exist. It is also listed the constant coefficient f that optimizes the corner merit C for 
g(x) = f(x) + f . The inverse polynomial g~ x {x) is computed by [16] g(x) = f~ l (x — f ). 

TABLE III 
QPPS WITH BEST 0' AND /3ub D (N) < D. 



N 


fo 


/(*) 


f~ l (x) 


D 


n' 


c 


P 


40 


6 


x + 10a; 2 


21a; + 10a; 2 


4 


2.77 


2 


0.45 


80 


72 


9x + 20x 2 


49a; + 20a; 2 


10 


4.61 


2 


0.45 


128 


89 


7x + Vox 1 


55a; + 16a; 2 


8 


6.24 


3 


0.45 


160 


115 


9x + 20x 2 


9x + 60a; 2 


10 


6.91 


3 


0.45 


256 


240 


15x + 32a; 2 


239a; + 32a; 2 


16 


8.32 


3 


0.45 


320 


304 


19a; + 40a; 2 


59a; + 40a; 2 


20 


8.99 


3 


0.45 


400 


375 


7a; + 40a; 2 


343a; + 120a; 2 


16 


13.86 


5 


0.45 


408 


273 


25a; + 102a; 2 


253a; + 102a; 2 


24 


6.36 


2 


0.45 


512 


433 


15a; + 32a; 2 


239a; + 32a; 2 


16 


11.09 


4 


0.45 


640 


549 


19a; + 40a; 2 


219a- + 200a; 2 


20 


11.98 


4 


0.45 


752 


619 


23a; + 94a; 2 


327a; + 94a; 2 


26 


9.77 


3 


0.45 


800 


786 


17a; + 80a; 2 


753a- + 240a; 2 


32 


17.33 


5 


0.45 


1024 


992 


31x + 64a; 2 


991a; + 64a; 2 


32 


13.86 


4 


0.45 


1280 


1248 


39a; + 80a; 2 


279a- + 80a; 2 


40 


14.76 


4 


0.45 


1504 


1463 


23a; + 94a; 2 




26 


13.03 


4 


0.45 


1600 


1169 


17a; + 80a; 2 


753a- + 240a; 2 


32 


20.79 


6 


0.45 


2048 


1315 


31a; + 64a; 2 


991a; + 64a; 2 


32 


24.26 


7 


0.30 


2560 


2377 


39a; + 80a; 2 


2199a; + 720a; 2 


40 


25.82 


7 


0.30 


3200 


2328 


17x + 80a; 2 


2353a; + 240a; 2 


32 


31.19 


9 


0.30 


4096 


1332 


31a; + 64a; 2 


991a- + 64a; 2 


32 


41.59 


12 


0.30 


5472 


3104 


77a; + 114a; 2 




36 


28.67 


8 


0.30 


8192 


1084 


31a; + 64a; 2 


3039a; + 2112a; 2 


32 


79.71 


23 


0.30 
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F. Permutation Polynomials of Degrees Larger than Two 

We have mentioned that while there are linear maximum- spread interleavers for every iV = 2n 2 , this is 
not true for quadratic permutation polynomials. For example, if N — 200 = 2 x 10 2 there are no maximum- 
spread interleavers of second degree. However, the cubic permutation polynomial f(x) = 59x+60a; 2 +20x 3 
(mod 200) generates a maximum- spread interleaves Further, interleaver lengths not admitting quadratic 
permutation polynomials at all may have permutation polynomials of larger degrees. For example, if 
iV = 5, there are no quadratic permutation polynomials but c(x) = x 3 (mod 5) is a cubic permutation 
polynomial of irreducible degree. This means maybe it is worth investigating polynomials of larger degrees 
because the complexity of evaluating the polynomials only grows linearly with the degree using Horner's 
rule [29, page 93]. The cubic polynomial f(x) = 59x + 60x 2 + 20x 3 (mod 200) can be evaluated at 
every point x with three multiplications and two additions using f(x) = (59 + (60 + 20x)x)x (mod 200). 
Further, it would be interesting if an efficient implementation that sequentially generates all evaluations 
/(0), /(l), /(2), . . . that requires only additions and comparisons for arbitrary polynomial degrees, gen- 
eralizing the idea in [17], is possible. To determine the coefficients for a permutation polynomial of 
an arbitrary degree and an arbitrary N, there is an easy sufficient condition by using Theorem 2.3 and 
Corollary 2.5 in [1]. 

IV. Numerical Results 

A. Distance Spectra of some Example Codes 

Algorithms for computing the true distance spectra of turbo codes such as in [30] and [26] are very 
useful to help analysis. We used the algorithm in [30] to compute the first 20 smallest distances and 
respective multiplicities for a few turbo codes using interleavers in Tables HVWl We constrained the 
search for input weights at most 10. The turbo codes are parallel concatenated codes of nominal rate 1/3. 
We used two types of constituent codes: the 8-state constituent convolutional code with generator matrix 
[1 (1 + D + D 3 )/{1 + D 2 + D 3 )], also denoted in octal notation as (13,15) and the 16-state constituent 
convolutional code with generator matrix [1 (1 + D + D 2 + D 4 ) /(l + D 3 + D 4 )], also denoted in octal 
notation as (23,35). The trellis termination method was the same as for the 3rd Generation Partnership 
Project (3 GPP) standard [31], i.e., UDT. 

We make the following observations: 

• Improving the corner merit C has mixed effects. It improves the minimum distance (highlighted in 
the tables) for certain cases but it degrades for others as commented in Section IIII-DI 

• The first spectral line with a high multiplicity has a multiplicity very close to the degree of shift 
invariance e as predicted in Section Illl-DI 

• The Cl' interleavers appear in general to improve the first spectral line that has a high multiplicity. 
However, the comparison is not straightforward because the distance spectra is truncated to the first 
20 lines. 

B. Computer Simulation Results 

The error performances of turbo codes using the maximum- spread QPP interleavers in Table HH as well 
as interleavers in Tables U and [Hi] are examined. The structure of the simulated turbo codes is the same 
as in the previous section. However, we simulated for both UDT and IDT. The true code-rates for 8-state 
constituent codes are N/ (3N + 12) and (N — 6)/3iV for UDT and IDT, respectively. The true code-rates 
for 16-state constituent codes are N/(3N + 16) and (N — 8)/3iV for UDT and IDT, respectively. 

The true code-rate is used to compute the signal-to-noise ratio (E b /N ). We used BPSK modulation and 
assumed an additive white Gaussian noise (AWGN) channel. The decoding was performed with log-MAP 
decoding and simulated until at least 50 frame errors had been counted, unless otherwise noted. 
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TABLE IV 

Length N = 128 



8-state 


MS QPP /(as) = 15a; + 32x 2 (mod AT) e = 64 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


16 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


Ni 


1 


1 


1 


2 


55 


2 


7 


8 


9 


16 


27 


120 


53 


359 


526 


391 


775 


1368 


1865 


2542 


Q! QPP /(as) = 7a; + 16s 2 (mod AT) e = 32 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


14 


15 


16 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


Ni 


2 


1 


1 


2 


4 


3 


8 


8 


33 


37 


24 


123 


72 


198 


111 


296 


578 


731 


1240 


1822 


n' QPP /(as) = 89 + 7x + 16s 2 (mod AT) e = 32 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




12 


16 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


Ni 


1 


1 


3 


2 


1 


7 


8 


34 


32 


15 


117 


61 


184 


119 


289 


532 


651 


1166 


1731 


3023 


16-state 


MS QPP /(as) = 15s + 32x z (mod N) e = 64 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




17 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


AT< 


1 


3 


2 


3 


1 


1 


3 


1 


6 


9 


14 


13 


52 


28 


199 


78 


79 


154 


235 


422 


n' QPP /(a;) = 7x + 16x z (mod N) e = 32 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


17 


21 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 




1 


2 


2 


2 


4 


5 


31 


18 


55 


23 


97 


103 


133 


253 


234 


596 


722 


1261 


1923 


3119 


n' QPP /(as) = 89 + 7x + 16x 2 (mod N) e = 32 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


41 


42 


2V< 


3 


1 


4 


5 


31 


9 


56 


16 


93 


101 


109 


233 


190 


577 


655 


1099 


1731 


2920 


4407 


6408 



1) Comparison with DRP Interleaves: We compare first length iV = 512 PP interleavers under similar 
conditions with DRP interleavers in [9]. The iterative decoding method used in [9] is simpler than log- 
MAP but worse by about O.ldB at lower SNRs. The DRP curves were obtained directly from [9] but 
adjusted in SNR to the true code-rate. We used 16 log-MAP decoding iterations to match their number 
of iterations. The simulation curves are compared in Fig. |5J 

There is a close match in performance with the DRP interleaver with parameter M = 4 at higher SNRs. 
The similarity in performance is not quite surprising if we consider that both PP and DRP constructions 
are based on number congruences. A deeper study of their resemblance is left for a future work, however, 
we provide a few insights of why QPP interleavers are expected to be close to DRP interleavers with 
M = 4 for this interleaver length of N = 512. 

The parameter M in a DRP interleaver is the length of an arbitrary permutation of M letters. Explaining 
only the essence, a DRP interleaver can be understood as a modification of a linear interleaver by using 
the permutation of M letters. We show that PP and DRP constructions are in general different, except 
when M — 1. When M — 1, DRP interleavers are what we call linear interleavers, i.e., PPs of first degree 
because no modification of a linear interleaver is possible if M — 1. As M grows, DRP interleavers can 
become arbitrarily "random" in the sense that when M = N, arbitrary interleaving functions are possible. 
The class of PP interleavers cannot generate arbitrary interleaving functions regardless of the degree of 
the permutation polynomial. This is easily proven by counting arguments but also because all interleavers 
generated by PPs are maximum contention-free [15] but an arbitrary interleaving function is generally not 
(maximum) contention-free [2]. 

Factoring out the construction algorithm, which is similar in complexity and nature, one may characterize 
PP and DRP interleavers by their input parameters (two vectors of length M for DRP interleavers and 
the coefficients of the polynomials for PP interleavers). We propose to measure the "randomness" of 
DRP interleavers by computing the entropy E of the two input permutations of M letters. Considering 
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TABLE V 

Length TV = 512 



8-state 


MS QPP f(x) = 31a; + 64a;* (mod TV) e = 128 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


41 


42 


43 


44 


45 


46 


Ni 


1 


2 


5 


1 


8 


3 


126 


4 


14 


14 


17 


960 


1923 


41 


304 


99 


730 


1113 


539 


406 


Q! QPP f(x) = 15a; + 32x J (mod TV) e = 64 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


16 


21 


22 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


Ni 


1 


1 


1 


1 


4 


2 


2 


3 


5 


7 


11 


13 


18 


16 


36 


30 


114 


200 


665 


543 


n' QPP /(x) = 433 + 15a; + 32a: 2 (mod TV) e = 64 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




20 


21 


24 


25 


26 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


41 




1 


1 


1 


5 


2 


1 


2 


5 


9 


15 


9 


13 


22 


27 


34 


114 


196 


669 


530 


430 


Degree-6 PP 512 


j 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 


di 


27 


28 


29 


30 


31 


32 


33 


34 


35 


36 


37 


38 


39 


40 


41 


42 


43 


44 


45 


46 


Ni 


2 


2 


5 


1 


5 


2 


9 


3 


14 


246 


79 


505 


563 


58 


76 


371 


617 


432 


591 


1324 


16- state 


MS QPP /(a;) = 31a; + 64^ (mod TV) e = 128 


i 





1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 


17 


18 


19 




26 


27 


29 


31 


33 


34 


35 


36 


37 


38 


39 


40 


41 


42 


43 


44 


45 


46 


47 


48 


Ni 


2 


1 


1 


1 


3 


1 


4 


3 


3 


4 


2 


7 


14 
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Fig. 5. Length TV = 512 PP interleavers compared with DRP interleavers in turbo codes with 8-state constituent convolutional codes and 
16 decoding iterations. 
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that an arbitrary sequence of M letters can be chosen, then the entropy is 2Mlog 2 (M) bits, which is 
independent of the interleaver length. For an interleaver length of N, the entropy of the coefficients in 
q(x) = qix + q 2 x 2 (mod N) is deg(q(x)) log 2 (iV/2) bits assuming that N is a power of 2 and g/s are 
either even or odd [1]. Now observing the previous matching in Fig. |5] for DRP (M = 4) and QPP, 
we have E(DRP) = 81og 2 (4) = 16 bits and E(QPP) = 21og 2 (256) = 16 bits with a perfect match. 4 
Would this be a coincidence? The DRP interleaver with M = 8 has an entropy of 161og 2 (8) = 48 bits, 
which would correspond to a degree-6 PP. We obtained a very close error performance with a degree six 
permutation polynomial. 



f(x) = I5x + 16x 2 + 128a; 3 + 32a; 4 + 32a; 5 + 64a; 6 (mod 512) 



(7) 



The polynomial in © has a degree of non-linearity £ = 8, a refined degree of non-linearity £' = 6 and 
the orbit size is e = 64. Its spread factor is D = 26 and has a refined product merit of Q' = 19.55. The 
corresponding performance curve is shown in Fig. |5] We used interleaved dual termination (IDT) [28] for 
this code, which gave a small advantage over UDT at high SNRs (it is not shown in the plot but about a 
factor of 2 at 2.0dB). 
In summary: 

• The maximum- spread interleaver (f(x) = 31x+64x 2 ) is mostly indifferent to the termination methods 
and very similar in performance to the DRP M = 4 and IDT. 

• The £1' interleaver (f(x) = 15a; + 32a; 2 ) has a significant improvement with IDT over UDT and is a 
little better than the maximum- spread code. 

• The degree-6 interleaver with IDT and DRP M — 8 interleaver have mostly the same performance. 
2) Performance Curves for 8-State Constituent Codes: We plot next the FER curves for the first four 

maximum- spread interleavers in Table UTI using UDT and the corresponding constant-free codes in Table HIT] 
using IDT for turbo codes using the 8-state (13,15) convolutional codes and eight decoding iterations. 
Similarly as in [15], excellent error performance is obtained down to at least an FER of 1CT 4 . There 
is noticeable improvement in FER for codes using Q! interleavers as the block length increases. Also, a 
truncated union bound is plotted using the 20 first spectral lines for two of the codes using maximum- 
spread interleavers (MS QPP N = 128 and MS QPP N = 512). 
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Fig. 6. FER curves for turbo codes with maximum-spread QPP interleavers, 8-state convolutional codes, and eight decoding iterations. 

4 It may be argued that the input complexity of DRP interleavers is log 2 (iV) higher because it requires the specification of a base linear 
interleaver that includes a constant coefficient. 
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The refined product merit effectively avoids the selection of bad interleavers. For example, the permu- 
tation polynomial 

31x + 64a; 2 + 64a; 3 + 32a; 4 + 64a; 5 + 32a; 6 (mod 512) 

has a spread factor D = 32 (a maximum- spread interleaver), a degree of non-linearity ( = 8, a simple 
product measure of £7 = 27.73 but a refined degree of non-linearity (' = 2, and a refined product measure 
of f2' = 6.93. The simulation performance at 1.75dB (not shown in plots) gives an FER of 6 x 1CT 5 , 
clearly inferior to the maximum- spread interleaver of second degree that has a larger (' = 3. 

3) Performance Curves for 16-State Constituent Codes: An impressive error performance [32] with 
FERs around 3 x 1CT 8 at an SNR of 1.25dB was demonstrated for a DRP interleaver with M = 8 in a 
turbo code using the (23,35) 16-state constituent code, IDT, and 16 decoding iterations. We show that a 
similar result is obtained with the QPP interleaver f(x) = 1463 + 23a; + 94a; 2 (mod 1504) in Table UTTI 
with the same constituent code, UDT, and 16 log-MAP decoding iterations. We have not simulated the 
constant-free case with IDT but it should provide an even better error performance. Other codes with 
interleavers in Tables 0] (MS) and Tables [Hi] (fi') were also simulated. 

A genie stopper for the decoding iterations (the iterations are stopped when the decoded information 
sequence completely agrees with the transmitted one) was used when simulating points at very low FERs. 
For the length iV = 8192 f2' QPP code, at 0.5dB, close to 6 million frames were simulated with no frame 
errors with a regular turbo decoder; additionally, almost 40 million frames were simulated with a genie 
stopper for the iterations, resulting in only three frame errors. Similarly, other points at very low FERs 
were simulated with the decoding parameters in Table |VU 

TABLE VI 

Simulation Parameters for low FERs in Fig.0 



N = 512 MS QPP IDT 2.00dB 




Frames 


Frame Errors 


Regular 


74,151,303 
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Genie 


657,736,347 
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Total 


731,887,650 
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N = 512 MS QPP UDT 2.00dB 
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Regular 


56,273,401 


10 
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Fig. 7. FER curves for turbo codes with QPP inteiieavers, 16-state constituent convolutional codes, and 16 decoding iterations. 

Although there was an evident improvent by using Q,' polynomials for larger block lengths using 8-state 
constituent codes, there is not a clear difference for the length N = 8192 using 16-state constituent codes 
within the reach of simulations. 

In addition, we observe the following for length N = 512: 

• Codes using both the maximum- spread interleaver (f(x) = 31x + 64a; 2 ) and the Cl' (f(x) = I5x + 
32a; 2 ) interleaver benefit significantly with IDT. 

• The code with the maximum- spread interleaver and IDT is better than the code with Cl' (f(x) = 
15x + 32x 2 ). 

• The code with the maximum- spread interleaver and IDT has a performance very close to the best 
interleaver in [8], a dithered diagonal interleaver with identical spread factor of D = 32. 

In summary, for resource-constrained applications, the combination of 8-state constituent codes, a 
maximum of 8 decoding iterations and QPP interleavers give excellent performance down to FERs around 
10~ 4 or smaller from short to medium information block sizes of up to 8192 bits. If 16-state constituent 
codes and a maximum of 16 decoding iterations are acceptable then QPP interleavers give impressive 
performance down to FERs close to 1CT 8 with little or no signs of error-floors. 

V. Conclusions 

The recently proposed construction of PP interleavers [1] and the subclass of QPP interleavers yield 
very good error rate performance for turbo codes in a number of practical examples [15], [17]. Interesting 
properties of QPP interleavers have been studied earlier [1], [15], [16]; however, their characterization 
is still in its infancy with many open questions. In this paper, the spread factor of QPP interleavers was 
studied. An infinite sequence of QPP interleavers achieving the maximum-spread was given. Moreover, 
several properties of PPs and effective measures that are relevant for turbo coding were investigated. We 
proposed a new refined product measure Q! for PP interleavers that is easily and quickly computed; a 
table of good interleavers according to the new measure is provided for several of the interleaver lengths 
reported in the literature. QPPs are convenient because of their small footprint; however, we provided 
some evidence that PPs with larger degrees than two may be necessary for very low FERs. Although, 
turbo codes are limited by a logarithmic growth on the minimum distance [21], that result is asymptotic: 
good codes at practical lengths achieving FERs close to 1CT 8 without signs of an error floor have been 
demonstrated earlier [32] using DRP interleavers. Similar results are demonstrated in this paper with QPP 
interleavers. 
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The work in [1] opened the doors to a class of interleavers for turbo coding that provides the combination 
of an excellent performance, elegant algebraic and geometric analysis, and simplicity of implementation; to 
the best of our knowledge, there are no other interleavers sharing simultaneously these three characteristics 
to their fullest extent. Many problems in turbo coding that were earlier treated empirically may now be 
recast to be solved systematically and rigorously: the design of multiple turbo codes [33] for an improved 
asymptotic minimum distance by classifying the properties of PP interleavers under function composition; 
and puncturing of code bits for higher data rates using the MCF theory [15] (a stronger generalization 
of an even-odd interleaver [13]) are only a couple of relevant examples. 

APPENDIX 

I. New upper bound on the spread factor D e 

A technique inspired from [22] is used to compute the upper bound ubn E (N). We use the same distance 
5 in Section ITD but over the space [0, N — l) 2 C M 2 and forming the metric space V = ([0, N — l) 2 , 5). 
In this metric space, a sphere of radius r\ has the shape of a square when projected over the Euclidean 
metric space as shown in Fig. |5] If two spheres of radii r 1 and r 2 touch each other then the distance 
between their centers is r\ + r 2 . 




' ► 

Fig. 8. Spheres in the metric space (V, 5). 

Before proceeding with the upper bound, it is straightforward to realize that in the metric space (R 2 , 5) 
there are only two types of densest packings for spheres with identical radius: aligned packing and 
unaligned packing as shown in Fig. |9l The unaligned packing is obtained by arbitrarily "sliding" stripes 
of the aligned packing. 

The upper bound on De is constructive. Given a square whose area is (N — l) 2 , we attempt to pack N 
spheres of identical radii r and maximize the radii of the spheres r. We do so for values of N for which 
clearly a subset of the aligned packing gives the densest packing as shown in Fig. [TO] We end up with 
1) several points touching the boundaries of V and 2) excess cover areas. 

There are two classes of values for N. The cases N = 8 and N = 18 belong to 



N = 2p 2 , p = 2,3,4. 




Fig. 10. Sphere packing over the metric space (V,<5). 
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where p is the number of points on the bottom edge. The upper bound is the distance between adjacent 
points, i.e., ub£> E (N) = (N — l)/(2p — 1). After some simple algebra, the upper bound u6 Dj3 (iV) is 



ub DE (N) 

The cases N = 13 and N = 25 belong to 



2(JV-1) 
V2N- 1 



N = p* + (j>-l) 2 , p = 2,3,4,.... 



The upper bound ubr, E (N) is 



ub DE (N) 



2(JV- 1) 



V2JV - 1 - 1 

II. A Geometric Approach for Maximum-Spread Linear Interleavers 

Although not explained in [12], it is clear that many candidates for an interleaver length iV achieving 
maximum- spread \/2N arc of the form iV = 2n 2 because those allow the optimal packing in (V, 5/v). 
This is illustrated in Fig. [TT] for N = 32. The dots show the potential places that may be occupied 
by a point of the interleaver-code. Without loss of generality, we place first a point in (0,0). Next, we 
place a point along the line —x + 8 (mod 32) and < x < 8 with the constraint that a linear curve 
that interpolates the first two points is a permutation polynomial. Then we follow a similar but simpler 
technique as we do to prove Theorem |2] in Appendix [Oil This leads to an alternate geometric construction 
for all maximum- spread linear interleavers (up to symmetries). 

The authors of [8] explain the so-called dithered diagonal construction using the same geometric 
approach. The difference with linear interleavers is that the placement of a second point does not fix 
all the remaining points. Therefore a different slide (or dither) is allowed for the other stripes provided 
that an interleaver constraint is maintained. 
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Fig. 11. Linear curves describing the "centers" of stripes in a perfect packing for iV = 32. 
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III. Proof of Theorem [5] 

The set of linear curves bi(x) = —x + %2n (mod N), < i < n is simply passing through the center 
of the stripes in either the aligned or an unaligned packing as show in Fig. [Til i.e., the smallest distance 
8^ between two points that belong to any two disjoint curves is 2n. If we show that the intersection of 
each of the curves b^{x) with f(x) has N/n solutions that are equally spaced by 5 N = 2n then we are 
done. 

We start by rewriting the infinite sequence © as function of n = 2 k ~ 1 . 

{2 k - l)x + 2 k+l x 2 = (2n - l)x + 8nx 2 (mod 2 2k ~ l = 2n 2 ) (8) 
The intersection of ® and a linear curve bi(x) is the solution to 

(2n — l)x + 8nx 2 = —x + i2n (mod 2n 2 ), 

or 




j 



We then transform the quadratic congruence © into a linear congruence 

2nj = (mod 2n 2 ), (10) 

whose set of solutions is 

j G {0, n, 2n, 3n, . . . , (2n — l)n}, 

i.e., we have 2n = N/n solutions that are equally spaced for (ITOb . To solve ©, we simply need to find 
the solution to 

— i + x + Ax 2 = j (mod 2n 2 ), 

when i and j are fixed. Observing that 4a; 2 + x (mod 2n 2 ) is a QPP, the solution for x is unique. Further, 
from the proof of the MCF property of permutation polynomials [15, Theorem 1], we know that if M 
divides N then a set of M equally spaced (modulo N) values by N/M is always mapped to an equally 
spaced set of values by a PP and also by its inverse PP. Therefore we establish the desired result. 

IV. Proof of Theorem [3] 

If A(k Q , fci) is an isometry of the interleaver-code Q = $(g) then we must have q(x — ko) +ki = q(x) 
(mod N). Developing it we have 

q 2 (x - k ) 2 + q x (x — k ) +kx = q 2 x 2 + q\X (mod N) 

q 2 x 2 + (qi - 2q 2 k )x - qik Q + q 2 k^ + ki = q 2 x 2 + q x x (mod N) 

and therefore we just need to ensure 2q 2 k = (mod N). This is a linear congruence and its solution is 
completely characterized in elementary number theory textbooks. 
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where k (i) is the i-th solution and 

fci(i) = qiko(i) - q2k (i) 2 (11) 

There are exactly gcd(2g 2 , N) distinct solutions, which means that each point in Q belongs to an orbit of 
size gcd(2g 2 , N), i.e., the degree of shift-invariance is e(Q) = gcd(2g 2 , N). Hence, from Proposition |5J 
the degree of non-linearity for QPPs is ((Q) = N/ gcd(2g 2 , N). 
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